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ABSTRACT 

The 1989 Summer Bilingual Program, funded for its 
third year by tax levy, served 2,365 limited-English-proficient high 
school students at 14 sites in Manhattan, the Bronx, Brooklyn, and 
Queens. Designed for the substantial number of students who are 
over-age for their grade, the program offered the 
English-as-a-Second-Language (ESL) and bilingual content courses 
needed for graduation. In response to recommendations from previous 
years, staff development was also offered. The program operated in 
conjunction with regular summer schools at each site. Program 
objectives were met in ESL and science instruction and came close in 
mathematics. Evaluation data on social studies were not available. 
The staff were supportive of program objectives but felt its weakness 
was in implementation. The most common criticisms were inadequate 
preparation time, lack of materials, incomplete transcript 
information from home schools, insufficient bilingual staff, a 
compressed learning schedule, and need for central coordination. 
Recommendations for program improvement include recruitment of more 
licensed and experienced bilingual staff, pre-session and continuing 
staff development, enlisting the cooperation of home school guidance 
counselors for improved placement, more central coordination to 
insure timely materials dissemination, rescheduled course and lunch 
hours, and collection of data for program evaluation. (MSE) 
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1989 SUMMER BILINGUAL PROGRAM 



SUMMARY 

• The 1989 Summer Bilingual Program was fully 
implemented. Students received instruction in English 
as a Second Language and bilingual content areas. 

• Based on analysis of the limited data submitted by 
schools, students met the objectives in E.S.L. and the 
content area objective in science. They came close to 
meeting it in mathematics. No data were available for 
the social studies objective. The project did not meet 
the staff development objective. 

The 1989 Summer Bilingual Program, funded for its third year 
by tax levy monies, served 2,365 ninth through twelfth grade 
Limited English Proficient (LEP) students at 14 sites in 
Manhattan, the Bronx, Brooklyn, and Queens. DesivTied for the 
substantial number of LEP students who were over-age for their 
grade, the program offered students the English as a Second 
Language (E.S.L.) and bilingual content area courses they needed 
for graduation. In response to recommendations from previous 
years, the program also included staff development. 

The Summer Bilingual Program operated in conjunction with 
the summer school sessions at each site. Students enrolled for 
up to three E.S.L. and bilingual content area courses. 
An Office of Research, Evaluation, and Assessment (OREA) staff 
member interviewed the program's administrative, counseling, and 
teaching staff, and observed classes. OREA collected data on 
program students, but the statistical analysis was limited 
because of a lack of data. 

Students me1 the program objectives in E.S.L. and science 
and came close t( meeting it in mathematics. It was impossible 
for OREA to assess the objective in social studies because the 
schools failed to return the necessary data. It was apparent, 
however, that the program enabled many to advance in their 
studies and facilitated timely graduation. 

The staff was supportive of the program's objectives but 
felt that its weakness lay in implementation. The most common 
criticisms were: inadequate preparation time, lack of materials, 
incomplete transcript information from home schools, insufficient 
bilingual staff, a compressed learning schedule, and a need for 
central coordination. 

The conclusions, based on the findings ot this evaluation 
lead to the following recommendations: 

• Intensify efforts to recruit more licensed and 
experienced bilingual staff. 
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Implement staff development sessions before the summer 
session begins and continue staff development 
activities throughout the program. 

Enlist the cooperation of home school guidance 
counselors to expedite the appropriate placement of 
students . 

Provide more central coordination to insure that 
materials are disseminated in a timely fashion. 

Reschedule summer session hours so that there is a 
half-hour lunch break before the third ninety-minute 
class. 

Collect the required data so as to make possible the 
assessment of program objectives. 
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I. INTRODUCTION 



This report documents the findings of the Office of 
Research, Evaluation, and Assessment's (OREA's) evaluation of 
the 1989 Summer Bilingual Trogram. In its third year of 
operation, and funded by tax-levy monies, the Summer Bilingual 
program served 2,365 ninth through twelfth grade Limited English 
Proficient (LEP) students at 14 schools; this represented an 
increase over the previous year of. four schools and 1,194 
students. The program offered students both English as a Second 
Language (E.S.L.) courses and the content area courses required 
for graduation. 

The Summer Bilingual Program's objectives were to allow 
students to remain on or get back to grade level, enable 
students to enrich their education through additional school 
courses, and provide sufficiently mature and able students with 
the opportunity to complete their high school programs in less 
than the normally required time. 

HISTORY O F THE PROGRAM 

In April 1987, principals of high schools with large LEP 
populations conducted a citywide study which revealed that a 
significant portion of LEP students were far enough behind 
schedule in completing their required courses that they would 
not be able to graduate after four years of study and, 
therefore, were at risk of dropping out. The Summer Bilingual 
Program sought to enhance LEP students' chances for timely 
advancement and graduation and thus lower the dropout rate. (A 
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more detailed description of the program's history can be found 
in the final reports of 1987 and 1968.) 

PARTICIPATING STUDENTS 

The Summer Bilingual program was implemented at 14 sites in 
Manhattan, the Bronx, Brooklyn, and Queens. (See Table 7l.) The 
program served LEP students who were typically over-age for 
their grade. Spanish, Chinese, and H![titian Creole were the most 
common native languages of program students* 

DELIVERY OF SERVICES 

The program operated in conjunction with the regular 
English-language summer school program. Program staft and 
school staff were interchangeable. Students attended three 
ninety-minute classes five days a week. The program provided 
E.S.L. classes at all -sites. For the first time, most sites 
were also able to offer bilingual content area courses this 
year. 

REPORT FORMAT 

This report is organized as follo^fs: Chapter II describes 
the evaluation methodology; Chapter III presents an analysis of 
the qualitative and quantitative findings of the evaluation; 
and Chapter IV offers conclusions and recommendations based upon 
the results of the evaluation. 
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TABLE 1 
PROGRAM SITES BY BOROUGH 



Borough High School 



Brooklyn Eastern District 

Erasmus Hall 
Franklin D. Roosevelt 
John Dewey 
Midwood 
New Utrecht 



Bronx Adlai E. Stevenson 

Morris 

Theodore Roosevelt 



Manhattan George Washington 

Martin Luther King, Jr, 
Seward Park 



Queens Long Island City 

Newtown 



A tota? of 14 high schools participated in the 1989 
Summer Bilingual Program. 

The largest number of participating high schools was in 
the borough of Brooklyn. 



II. EVALUATION METHODOLOGY 

EVALU^TION QUESTIONS 

The evaluation assesses two major areas: program 
implementation and outcomes. Evaluation questions included the 
following: 

Process/Implementation 

• Did the program select students for program 
participation according to specific criteria? 

• Did the program place target students according to 
their current level of performance? 

• Did the program implement staff development activities 
as planned? 

Outcome 

• What percentage of program students passed their 
courses in mathematics, science, and social studies? 

• What percentage of program staff were satisfied with 
their training in terms of its relevance, 
applicability, comprehensibility, and accuracy? 

EVALUATION PROCEDURES 
Sample 

OREA field consultants visited three sites: Seward Park, 
Eastern District, and Theodore Roosevelt High Schools, in 
Manhattan, Brooklyn, and the Bronx respectively. OREA selected 
these schools because they had representative student 
populations. Field consultants interviewed teachers, guidance 
counselors, and administrative staff and observed classes in 

4 
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E.S.L. and bilingual content areas. 



Instruments 

OREA developed questionnaires for site supervisors, guidance 
ccunselors, and teachers, as well as surveys for students. OREA 
staff translated student surveys into Spanish, Haitian Creole, 
Chinese, and Korean. 

Data Collection 

Consultants interviewed program staff and observed classes 
over a three-week period from July 26 to August 14, 1989. OREA 
distributed student data forms to the program directors in early 
August and received the completed forms from the sites in early 
September . 

Data Analysis 

Although a total of 2,365 students participated in the 1989 
Summer Bilingual Program, analysis of objectives was based on 486 
or fewer students because of missing data. OREA determined 
whether or not the program objectives were met by obtaining 
frequencies. 
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III. EVALGATION FINDINGS 



The 1989 Summer Bilingual program provided students with 
E.S.L. and bilingual content area courses in social studies, 
mathematics, and science.. 

STUDENT PIACEMENT ANE PROGRAMMING 

To participate, students had to demonstrate limited English 
proficiency. Students were designated as LEP if they scored 
under the twenty-first percentile on the Language Assessment 
Battery (LAB).* In addition to the score on the LAB, 
eligibility guidelines reflected the program's goals. 
Enrollment was open to LEP students in three categories: high 
school seniors who needed tnree subjects in order to graduate by 
August 1989; ninth- through twelfth-graders who had failed 
subjects; and students who wished to accelerate their studies. 

The criteria used to place students at different levels of 
E.S.L. instruction and in bilingual content area courses 
included data taken from student's records, guidance counselor 
recommendations, placement tests where appropriate, and 
student requests. Teachers, counselors, and administrative 
s^iff repeatedly criticized the placement process. The major 



*The Language As; essment Batterv flAB^ was developed by the 
Board of Education of the City of New York to measure the 
English-language proficiency of non-native speakers for English 
in order to determine whether their levdl of English proficiency 
is sufficient to enable them to participate effectively in 
classes taught in English. Students scoring below the twenty- 
first percentile on the LAB are entitled to bilingual and E.S.L. 
services. 

6 
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problem was that home schools were supposed to give each student 
a "Summer School Application and Transcript Card" that 
determined their placement. Schools frequently provided these 
late or in an incomplete state, or did not provide them at all. 
Summer school staff often had to spend valuable teaching time 
determining students* placement. 

INSTRUCTIONAL ACTIVITIES 
English as a Seco nd Language 

Implementation . The E.S.L. classes observed by OREA field 
consultants focused on grammar, vocabulary, reading 
comprehension, and verbal and writing skills. 

In a level 3 E.S.L. class at Eastern District High School, 
students recited ten vocabulary words xn unison, three times 
with their teacher and once without. The teacher reviewed the 
meaning of the words by asking students for definitions and by 
giving a formal definition for each. Students then took turns 
reading passages containing their vocabulary words aloud from 
their workbooks. The teacher then divided the class into small 
groups to answer reading comprehension questions. The teacher 
checked the answers and made corrections where necessary. 
Students then wrote sentences using the vocabulary words. 
Volunteers read sentences to the class and the teacher corrected 
the grammar. 

At Theodore Roosevelt High School a level 6 E.S.L. class 
focused on reading comprehension, vocabulary identification, and 
writing. The topic for the day was the various forms of 

7 
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marriage. Students discussed the positive and negative 
characteristics of the different types of marriage they had read 
about in a magazine article. Students read vocabulary words and 
phrases aloud and gave meanings for them. The students then 
wrote about the form of marriage they preferred. 

Outcome . The program objective for E.S.L. was: 

• Seventy-five percent of the participating students 

will pass their E.S.L. courses with a minimum grade of 
65. 

Data were available for 21 percent (486) of the students. 
Of these, 78 percent (379) obtained a score of at least 65 on 
the final test. The program met this objective for E.S.L., 
based on those students for whom there were data. 

Content Area Subjects 

Implementation . An OREA consultant observed two bilingual 
content area classes: global history (Chinese) at Seward Park 
High School and economics (Spanish) at Eastern District High 
School. Both classes focused on teaching students subject 
material and English names and expressions for key terms and 
concepts . 

The global history class examined how certain geographical 
conditions had affected Italy's early development. Students 
identified Italy, Rome, and the Alps on the class map. The 
class was primarily lecture, but students' questions and 
responses were integrated throughout. Students were able to 
answer questions based on the day's lesson and draw parallels 
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between Italy end other countries. At the end of the lesson, 
students read aloud the summar); notes written in English on the 
board. They repeated key phrases and terms In English, then 
wrote them in both English and Chinese in their notebooks. 

The economics class concentrated on inflation and its 
causes. Students participated by discussing their experiences 
with inflation in their rative countries. They also discussed 
such concepts as cost of living, standard of living, and 
budgeting. The teacher used charts, graphs, and mathematics to 
aid in her explanations. The class read in Spanish, repeating 
English translations for economic terms and basic consumer goods 
such as bread, oil, and clothing. 

Outcome . The program objective for content area subjects 

was: 

• Seventy -five percent of the participating students will 
pass their content area courses with a minimum grade of 
65. 

Data were available for 16 percent (374) of the students 
taking science. Of these, 90 percent (337) obtained a score of 
at least 65. 

Seventy-one percent of the students taking mathematics, for 
whom data were available, achieved a score of 65 or above. 

No data were available for students enrolled in social 
studies . 

The Summer Bilingual Program partially met its objective in 
content area subjects. 

9 
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Among the instructional limitations were a lack of 
materials, a compressed learning schedule, and a lack of 
staff. Both teachers and site supervisors felt that guidebooks 
outlining class material and giving suggestions on how to 
conduct a 90-minute class were needed to alleviate problems 
caused by the short preparation time allotted by summer 
contracts. Many E.S.L. classes lacked adequate texts anc 
materials, and bilingual content area teachers said that they 
needed more native language texts. 

Problems also stemmed from the scheduling of three 
consecutive 90-minute periods of instruction. By the third 
period, teachers and students were tired. Many students used 
the first 15 minutes of this period for a lunch break. This cut 
class time in the already shortened six-week summer session. 

Most sites were inadequately staffed. Bilingual teachers, 
difficult to recruit during the school year, were even more 
scarce in the summer. As a result, man^ high schools could not 
offer requested content area courses. In some cases, teachers 
not qualified to handle the intensive summer session were 
dismissed in the first few days of classes. Their classes were 
either canceled or combined. 

NON-INSTRUCTIONAL ACTIVITIES 

Staff:J)j»yelopment 

Implementation . In response to OREA's recommendation in 
its previous report, the Summer Bilingual Prograiii included staff 

10 
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development as a program component. Training activities varied 
by site. At some schools, site and subject area supervisors 
conducted periodic training sessions. They gave teachers tips, 
for example, on how to approach a 90-minute lesson. Central 
staff developers visited most schools, observing classes and 
offering suggestions. A small number of teachers (3 of the 28 
who responded) reported that they had received no such visitors. 

While the staff was supportive of the program's training 
objective, they felt there were limitations to its 
implementation. The most common criticism was that there was 
not enough central coordination. Staff felt that there should 
be a program coordinator who outline< the program, supervised 
group training sessions, and made su; "i materials were properly 
disseminated. Respondents suggested that time be allotted for 
preparing staff before the start of the summer session. They 
also maintained that staff developers provide training 
throughout the six-week period. 

Outcome . The program objective for staff development was: 

• Eighty-five percent of staff will be satisfied with 
their training as demonstrated by Likert scale scores 
between 4 and 5 (on a scale of 1 to 5, 5 being the 
highest) on a "Staff Satisfaction Questionnaire." 

Only 65 percent of program staff gave scores of four or 

five to the relevance, applicability, comprehensibility, and 

accuracy of their training. The Summer Bilingual Project of 

1989 did not meet its staff development objective. 

11 
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IV. CONCLUSIONS AND RECOKMENDATIONS 



The 1989 Summer Bilingual Program offered LEP students the 
opportunity to progress in their required course sequences toward 
timely graduation through a variety of E.S.L. and content area 
courses. The program achieved its objectives in E.S.L. and 
science and came close to meeting its objective in mathematics. 
A lack of data made it impossible to ascertain whether or not it 
was successful in social studies. It was apparent from available 
data that the program was at least partially successful in its 
instructional component. 

Staff ind^oated that they were supportive of the program's 
objectives but that they had encountered many problems with 
program impleruentation this year. The most common criticisms 
were inadequate preparation time, insufficient bilingual staff, 
lack of materials, incomplete transcript information from home 
schools, and a compressed learning schedule. 

While the 65 percent who indicated that they were satisfied 
with the staff d< velopment was certainly under the 85 percent 
proposed in the objective, it does indicate that more than half 
the teachers were satisfied with this component of the program. 
It is a beginning that the program can improve upon next year. 

The conclusions based on the findings of this evaluation 

lead to the following recommendations: 

• Intensify efforts to recruit more licensed and 
experienced bilingual staff. 
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Implement staff development sessions before the summer 
session begins and continue staff development 
activities throughout the program. 

Enlist the cooperation of home school guidance 
counselors to expedite the appropriate placement of 
studen«.s. 

Provide more central coordination to insure that 
materials are disseminated in a timely fashion. 

Reschedule summer session hours so that there is a 
!*alf-hour lunch break before the third ninety minute 
class. 

Collect the required data so as to make possible the 
assessment of program objectives. 
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